Autonomous vehicle interaction system

ABSTRACT

Windows including sunroofs of a car may be enabled to display cinematic video, still pictures, opaque content, or picturesque content such as the countryside to simulate various environments while driving. On the outside of the autonomous vehicle advertising content may be shown on digital displays to pedestrians, bystanders, and other vehicle, autonomous vehicle or semi-autonomous vehicle passengers. Advertising revenue may offset vehicle leasing, maintenance, fuel, and ridesharing costs. Ad networks may send local offers content for presentation on the vehicle, autonomous vehicle or semi-autonomous vehicle&#39;s windows. Passengers may order food and interact with ads on the car window. The car windows may be multi-touch enabled to allow for various gestures and interactivity with the vehicle, autonomous vehicle or semi-autonomous vehicle. Chairs in the car may be rotated to allow for better positioning of the passenger to window screens.

CROSS REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of U.S. Provisional Application No.62/474,889 filed on Mar. 22, 2017; the aforementioned application ishereby incorporated by reference in its entirety.

BACKGROUND

There is a large amount of time spent in vehicles and on roads.Increasingly with autonomous vehicles and ride sharing networks,passengers are enabled with greater freedom and time to engage innon-driving activities. The technical field herein relates to vehicle,autonomous vehicle or semi-autonomous vehicle entertainment andadvertising systems both inside and outside the vehicle, autonomousvehicle or semi-autonomous vehicle.

SUMMARY

The summary contained herein reflects some of the aspects of the presentdisclosure. The disclosure as a whole should be considered toappropriately identify the scope and aspects of the elements of thisdisclosure.

This disclosure relates to the use of various surfaces, such as theglass windows of a car, for media and advertising interactivity.

This disclosure is concerned with enabling car and other vehicle,autonomous vehicle or semi-autonomous vehicle, to display video,pictures, and multimedia content on the window surface itself. In somevariations, the windows and sunroof within a vehicle, autonomous vehicleor semi-autonomous vehicle, may display multimedia content such aspictures, videos, and advertisements tailored to the individuals insidethe car. In some embodiments, the windows may be enabled as interactivesmart windows with touch screen capabilities. Certain manufactures mayintegrate the smart window into the vehicle, autonomous vehicle orsemi-autonomous vehicle, itself. In other variations, the smart windowmay be pasted onto the existing windows using technology with LCD, LED,or OLED screens. After market smart windows may enable the broad use ofexisting cars to join a mobile vehicle, autonomous vehicle orsemi-autonomous vehicle, ad network. In various instances, it isanticipated that manufacturers may enable a financing option for theirvehicles such that those vehicles equipped with a smart window adnetwork can use the advertising dollars to defray the vehicle,autonomous vehicle or semi-autonomous vehicle financing, leasing, orfuel costs.

In other variations, the outside of the vehicle, autonomous vehicle orsemi-autonomous vehicle including the windows of the car mayadditionally be enabled with advertisements and media content to allowfor dynamic vehicle, autonomous vehicle or semi-autonomous vehicledriving billboards. The vehicles, autonomous vehicles or semi-autonomousvehicles may be linked to one another to allow for unified advertisingacross vehicles, autonomous vehicles or semi-autonomous vehicles such ason a freeway, conference, or a local geographical area. In someinstances, vehicles, autonomous vehicles or semi-autonomous vehicles mayaudit each other so as to determine the effectiveness of the advertisingcampaign including the number of cars that are exposed to an outsidevehicle, autonomous vehicle or semi-autonomous vehicle window.

The disclosure further has applicability to various devices includingautonomous vehicles, autonomous vehicles or semi-autonomous vehiclesprograms and ride sharing programs. This disclosure provides for asystem to enable entertainment and advertising within, outside,pertaining, and related to vehicles, autonomous vehicles orsemi-autonomous vehicles, droves, trains, planes, moving electronicobjects, and related items.

It is an aspect of the present disclosure to enable a distributedentertainment and advertising network based on vehicles including cars,trucks, vans, drones, UAVs, flying cars, flying drones, includingautonomous or self-driven vehicles.

It is an aspect of the present disclosure to enable various software tobe implemented in a non-transitory computer readable medium stored in amemory. The electronic devices include those that are further comprisingof a processor, multiple processors, graphics cards, graphics chips,compute servers, computer memory systems, cloud connected streamingservices, cloud connected infrastructure.

Video and Multi-Touch Windows on the Car

It is an aspect of the present disclosure to enable the windows of thecar to be a multi-touch surface. The surface of each window may beindividually used or be used in unison with the other windows on thecar. Each window face may be enabled with multiple surfaces above aglass material. Alternatively, other materials may be used includingplastic.

Various Smart Windows and Smart Glass surfaces may be enabled in the carto allow for touch enabled displays or non-touch enabled displays to beplaced on the windows of the vehicle, autonomous vehicle orsemi-autonomous vehicle.

The displays may be HD, Ultra HD, HDR capable, with various nits ofbrightness. The displays may be LCD, LED, OLED, AMOLED, or otherformats. Displays may be multi-touch or controlled from paired wearableor mobile devices.

Connectivity and Mesh Networks for Multimedia Experiences on Vehicle,Autonomous Vehicle or Semi-Autonomous Vehicle Windows

The smart windows may be enabled with connectivity via various wirelesstransmit and receive processors and communication units for connectivityto other vehicles, autonomous vehicles or semi-autonomous vehicles,cellular networks, WiFi Networks, Bluetooth networks, millimeterwavelength protocols, and other wired and wireless communicationmethods. Various aspects in this disclosure include the ability toprocess signals, communication signals, and other data processinglocally or in the cloud.

In an aspect of the disclosure, there is a local computing unitincluding a computer or server contained within the vehicle, autonomousvehicle or semi-autonomous vehicle or the use of one or more mobiledevices.

A vehicle, autonomous vehicle or semi-autonomous vehicle itself may beenabled with one or more wireless transmit and receive units. Theseunits may be enabled to be paired directly with a specific window of thevehicle, autonomous vehicle or semi-autonomous vehicle. These can beidentified as the front windshield, left mirror, right mirror, passengerfront window, and so forth. A mobile device such as a cellular telephonecan be paired with a window of the vehicle, autonomous vehicle orsemi-autonomous vehicle to stream content or to send content from themobile device to the window.

In yet another embodiment, a mobile device may connect to the server andthe central command infrastructure for the vehicle, autonomous vehicleor semi-autonomous vehicle. The vehicle, autonomous vehicle orsemi-autonomous vehicle media system can then coordinate the content tobe sent to the windows of the mobile device.

It is an aspect of the present disclosure to have a media streaming andcentral compute device such as a server or a computer that leverages thecapability of multiple devices. In this instance, a plurality of devicesmay be enabled to act in unison to download content and stream saidcontent to a local display.

The smart window may make use of an Organic Light Emitting Diode (OLED)or LCD like interface. In these instances, an OLED may be enabled to bestuck on the windows of a vehicle, autonomous vehicle or semi-autonomousvehicle in a standardized format or a custom format. The connectivityfrom the stick-on OLED display may include a connectivity wire thatconnects to electronics housed in a strip at the base of the pasted OLEDdisplay. In other instances, an LCD panel may be used as part of thedisplay integrated into the vehicle, autonomous vehicle orsemi-autonomous vehicle window from the manufacturer. That is in oneembodiment, the vehicle, autonomous vehicle or semi-autonomous vehiclemay be enabled with smart windows and display directly from themanufacturer and in other embodiments the smart windows and display maybe integrated as part of an aftermarket solution.

It is an aspect of the smart windows that they may be connected via awired or wireless communication method from the window to a mobiledevice or a vehicle, autonomous vehicle or semi-autonomous vehiclecentral entertainment hub. In the wired instance a USB, USB 2.0, USB-C,micro-USB Ethernet, or other dongle may be available from the centralvehicle, autonomous vehicle or semi-autonomous vehicle entertainmentarea or form one or more mobile devices, wearable devices, cellulartelephones other electronic devices, local or network servers.

It is an aspect of the present disclosure to enable front and backfacing smart windows. In this instance two separate panels may be placedusing an adhesive or other mechanism on a window or dual panel smartwindows may be included directly from the manufacturer.

It is an aspect of the present disclosure to enable variousadvertisements to be displayed on the windows of the vehicle, autonomousvehicle or semi-autonomous vehicle. In this embodiment, theadvertisement may be personalized based on various criteria includingthe people within the car, the location, the vehicle, autonomous vehicleor semi-autonomous vehicle type, to starting point, the destinationpoint, the local companies close by, among other factors.

In yet another variation, the advertisements and media may be displayedon the outside of the window. In this instance, the advertisements maymake the vehicle, autonomous vehicle or semi-autonomous vehicle abillboard advertisements for one or more brands, products, or services.The ad units may be purchased on a specific window basis, on all thewindows of a car, or all the vehicles, autonomous vehicles orsemi-autonomous vehicles within a region. An ad server or a plurality ofad servers or ad networks may track the audience in the vehicles,autonomous vehicles or semi-autonomous vehicles and deliver targeted adsfrom a first vehicle, autonomous vehicle or semi-autonomous vehicle to asecond vehicle, autonomous vehicle or semi-autonomous vehicle based onthe location and trajectory of the first and second vehicle, autonomousvehicle or semi-autonomous vehicle. That is a certain customer orsegment of customers is in vehicle, autonomous vehicle orsemi-autonomous vehicle 1 and that vehicle, autonomous vehicle orsemi-autonomous vehicle is in the proximity of a vehicle, autonomousvehicle or semi-autonomous vehicle 2, wherein proximity may bedetermined by location, GPS, sound, millimeter wave length or anotherformat, then the ads of vehicle, autonomous vehicle or semi-autonomousvehicle 2 may be displayed on vehicle, autonomous vehicle orsemi-autonomous vehicle 2's windows such that they are viewable fromvehicle, autonomous vehicle or semi-autonomous vehicle 1.

In this instance, the auditing of the advertisements provides a view asto what the passengers of vehicle, autonomous vehicle or semi-autonomousvehicle 1 viewed. The auditing may be enabled by mapping the locationtime between vehicle, autonomous vehicle or semi-autonomous vehicle 1and vehicle, autonomous vehicle or semi-autonomous vehicle 2 and theamount of time they are in the viewable distance of each other. In thisinstance the viewing area may be defined as the peripheral and centralvision of a passenger in a given window of a vehicle, autonomous vehicleor semi-autonomous vehicle 1 against the advertising side and window ofvehicle, autonomous vehicle or semi-autonomous vehicle 2. This may bedetermined from the vehicle, autonomous vehicle or semi-autonomousvehicle itself as the vehicles may be in direct communication with eachother view millimeter wavelength communication, Bluetooth, WiFi, orother communication protocols. It may alternatively be enabled by thepresence of traffic cameras or other fixed and moveable position camerason the vehicles, autonomous vehicles or semi-autonomous vehiclesthemselves, streetlights, lamp posts.

It is an aspect of the present disclosure to enable a display such thatthe inside display may include a picture of the outside of the car usinga camera affixed to the smart window or from the top of the vehicle,autonomous vehicle or semi-autonomous vehicle such that the insidepassenger is not readily cognizant of the advertisement available on theoutside of the vehicle, autonomous vehicle or semi-autonomous vehicle.Alternatively, a passenger in the seat may be enabled to use a mobiledevice, a wearable device, a button on the door handle to view a projectscene or a movie on the display of the window instead of the actualsurroundings. Responsive to this situation, an advertisement may then beenabled on the outside of the window. The advertisement may be served upby an ad server, an ad unit sent from a server, or an ad unit that iscached by the vehicle, autonomous vehicle or semi-autonomous vehiclememory or a mobile device's memory.

It is an aspect of the present disclosure to enable drivers and ownersof vehicles, autonomous vehicles or semi-autonomous vehicles to collectmonetization review associated with the views of their vehicles. Adriver may receive cash, gas credits, or other items based on the numberof miles driven with an ad associated with. The ads may be monetized ona CPM basis cost per impression or a cost per action (CPA) or cost perengagement (CPE) or other mechanism.

It is an aspect of the present disclosure to enable monetization basedon a plurality of metrics including the size of the full display, numberof impressions of the vehicles, autonomous vehicles or semi-autonomousvehicles on the road, number of advertisements displayed, type ofadvertisement, duration of advertisement, and location of advertisement.

It is an aspect of the present disclosure to enable discounted rates forridesharing or autonomous vehicles that display or do not displayadvertisements. Various regulatory authorities may indeed blockadvertisements in their jurisdiction.

It is further an aspect of the present disclosure that the technologyand teachings including smart windows may be used in other movableobjects such as planes and trains. As an example, the windows of anairplane may be enabled to be smart connected windows that providevarying displays of different contexts, videos, movies, and scenes.Further, in yet another embodiment various windows of trains and carsmay be used including the sunroof, passenger windows, and side viewmirrors.

BRIEF DESCRIPTION OF SEVERAL VIEWS OF THE DRAWING

The accompanying drawings, being incorporated in and forming a part ofthis specification, illustrate embodiments of the disclosure and,together with the description, serve to explain the principles of thepresent disclosure.

FIG. 1 depicts various modules and units of the system including a CPU,processor, and circuitry of a network connected moving vehicle,autonomous vehicle or semi-autonomous vehicle system.

FIG. 2 depicts a network connected vehicle, autonomous vehicle orsemi-autonomous vehicle with a smart window system including a firstwindow and a second window including a first side and a second side.

FIG. 3 depicts a vehicle, autonomous vehicle or semi-autonomous vehiclein communication with other vehicles for vehicle, autonomous vehicle orsemi-autonomous vehicle to vehicle, autonomous vehicle orsemi-autonomous vehicle advertising and auditing.

FIG. 4 depicts a vehicle, autonomous vehicle or semi-autonomous vehicleto vehicle, autonomous vehicle or semi-autonomous vehicle in motionadvertising system wherein a third vehicle, autonomous vehicle orsemi-autonomous vehicle functions as an auditor of the other vehicles.

FIG. 5 depicts a large truck vehicle, autonomous vehicle orsemi-autonomous vehicle with multiple digital displays for advertisingon a roadway.

FIG. 6 depicts a touch sensitive vehicle, autonomous vehicle orsemi-autonomous vehicle window capable of display multimedia content.

FIG. 7 depicts a moving transportation object with a plurality of smartwindows enabled to display varying video content on each window screen.

FIG. 8 depicts a car window with an OLED display capable of digitalmedia presentation.

FIG. 9 depicts various aspects of an touch screen display includingconverters and filters.

FIG. 10 depicts an architecture of connectivity between a vehicle,autonomous vehicle or semi-autonomous vehicle connectivity radio, in carentertainment and control dashboard, mobile device, media server, andsmart window.

FIG. 11 depicts various monetization aspects of the vehicle, autonomousvehicle or semi-autonomous vehicle advertising network.

FIG. 12 depicts synchronization of the smart vehicle, autonomous vehicleor semi-autonomous vehicle window with lighting and other subsystems ofthe vehicle, autonomous vehicle or semi-autonomous vehicle.

DETAILED DESCRIPTION

Referring now to FIG. 1, FIG. 1 depicts an overall view of the systemincluding a vehicle, autonomous vehicle or semi-autonomous vehicle witha smart window 100. A smart window system may include a display In thisillustrative embodiment, the smart window device may be enabled with ahousing to contain various electronics and circuitry. The housing maycontain one or more CPU, Memory 102, wireless transmit and receiveunits, display, touch screen controllers, and haptic feedback devices.The smart window system may be enabled to directly connect to thevehicle, autonomous vehicle or semi-autonomous vehicle's wirelessconnectivity system or the smart window system may be enabled withwireless connectivity itself 104 or may leverage the car's centralwireless connectivity system. That is the smart window may use alocalized network communication protocol such as WiFi, 802.x (anyvariation) Bluetooth, Bluetooth LE, Zigbee, or other protocol for nearbycommunication to other devices.

Still referring now to FIG. 1, the smart window may connect to a cloudserver(s) 112 for streaming media content 114, pictures, videos,advertisements, software updates, social networks, and other networkaccessible content. The vehicles, autonomous vehicles or semi-autonomousvehicles as part of this disclosure may be enabled with variousmulti-cameras 118 which include identification of people, vehicles,cars, and contexts. The vehicles, autonomous vehicles or semi-autonomousvehicles may further be enabled with LiDAR 120 or various radardetection. These smart windows may be enabled as part of an autonomousor ride sharing system. In these instances the smart windows may act asa security measure to display warning information to outside vehiclesand passengers if there is an issue in the car. Alternatively, they mayprovide entertainment to the individuals with the car.

Referring now to FIG. 2, FIG. 2 depicts a vehicle, autonomous vehicle orsemi-autonomous vehicle 200 with a first window 201 and a second window202. Certain windows such as the first window 201 may be enabled with ainside car facing display side 204 and a outside side/street facingside/back side 206 which faces the street. The windows may be enabled todisplay content on the first side of the device 204 and on the backsideof the device 206 sequentially or simultaneously. The display of contentmay be simultaneous such that content can be targeted to the insidepassenger on the inner display side 204 and on the outside display side206 are viewing different content concurrently.

The outside display side 206 for example may display content such asvideo and advertisements in accordance with an ad network. The outsideside may display offers of local vendors. The smart window itself may beenabled with GPS or a location based positioning service. Alternatively,the smart window may leverage the GPS location data of the vehicle,autonomous vehicle or semi-autonomous vehicle itself, one or more mobilephones in the vehicle, autonomous vehicle or semi-autonomous vehicle,location based beacons, image recognition of localized objects, or soforth.

The windows of the vehicle, autonomous vehicle or semi-autonomousvehicle may also match and redisplay those images and ad units frombillboards. This process may be based on a location based system of thecar in proximity to a known billboard. An ad server or ad network mayfurther geofence certain areas for ads. An ad network may enablepurchasers to buy demographics where the demographics include the typeof vehicle, autonomous vehicle or semi-autonomous vehicle includingmake, model, and color.

Referring now to FIG. 3, FIG. 3 depicts three vehicles includingvehicle, autonomous vehicle or semi-autonomous vehicle 1, vehicle,autonomous vehicle or semi-autonomous vehicle 2, and vehicle, autonomousvehicle or semi-autonomous vehicle 3. Some or all of the vehicles may beenabled with one or more types of smart windows including manufacturebased smart window, post market smart windows, side window smartwindows, sunroof smart windows, or back panel smart windows. Vehicle,autonomous vehicle or semi-autonomous vehicle 3 for example ispositioned in front of vehicle, autonomous vehicle or semi-autonomousvehicle 2 on a roadway. In this instance vehicle, autonomous vehicle orsemi-autonomous vehicle 3 has a rear-view smart window 306 to allow foradvertisements on the back side of the vehicle, autonomous vehicle orsemi-autonomous vehicle. The advertisements may be targeted based on theprofile information available about vehicle, autonomous vehicle orsemi-autonomous vehicle 2. As different vehicles enter the line of sightof the advertisement of vehicle, autonomous vehicle or semi-autonomousvehicle 3, the advertisement may change. Alternatively, theadvertisement may change based on the location. The determination of thecar behind vehicle, autonomous vehicle or semi-autonomous vehicle 3 maybe obtained via a camera that is integrated into the smart window orbased on LiDAR or cameras already on vehicle, autonomous vehicle orsemi-autonomous vehicle 3. Alternatively, vehicles may self select tojoin a discovery network or mesh network and share profile informationamong each other using a wireless communication protocol such as WiFi,Bluetooth, or millimeter wavelength communication.

The vehicles 300, 302, 306 can interact with smart vehicle, autonomousvehicle or semi-autonomous vehicle signs such as 308. These signs mayinclude a radar component, digital still or video camera, or otheridentification components that enable digital signage to be placed onthe sign and targeted to the vehicles that are approach. As an example,a car that is progressing to a local fast food diner may be identifiedand an advertisement may be placed on the temporarily replacing a speedlimit sign or destination distance sign. These ad units on signs mayfurther be relevant in the case where the sign determines that thevehicle should be communicated to with non-visual methods such aswireless transmit and receive messages may be sent between the sign 308and a vehicle, autonomous vehicle or semi-autonomous vehicle 300.

In displaying an advertisement on the backside of the smart window ofvehicle, autonomous vehicle or semi-autonomous vehicle 3 may create alack of visibility of the vehicle, autonomous vehicle or semi-autonomousvehicle 3 driver to view the rear of the car. In this variation, one ormore cameras of the smart window or of the vehicle, autonomous vehicleor semi-autonomous vehicle itself may be enabled to capture in real timethe video behind the vehicle, autonomous vehicle or semi-autonomousvehicle and display the video behind the vehicle, autonomous vehicle orsemi-autonomous vehicle on one or more dashboards or a rear view mirror310. That is the rear view mirror of the vehicle, autonomous vehicle orsemi-autonomous vehicle may be enabled to display not mirrored contentbut an actual video feed behind the vehicle, autonomous vehicle orsemi-autonomous vehicle. Alternatively, the inside facing portion of thesmart window itself may display a video feed of the backside of the car.In this instance, the driver of vehicle, autonomous vehicle orsemi-autonomous vehicle 3 would see the roadway behind the vehicle,autonomous vehicle or semi-autonomous vehicle as a real time video feedand the outer facing portion of the smart window would still displayadvertisements to other passengers such as those in vehicle, autonomousvehicle or semi-autonomous vehicle 2.

Referring now to FIG. 4, FIG. 4 depicts an advertising audit system. Invarious instances it is important to have a basis of reporting as to thecars in proximity and the likelihood of an advertisement being displayedto passengers. In this variation, a vehicle, autonomous vehicle orsemi-autonomous vehicle 1 may be used to audit the advertisements ofvehicle, autonomous vehicle or semi-autonomous vehicle 3 and determinewhether the advertisement was indeed shown to the passengers in vehicle,autonomous vehicle or semi-autonomous vehicle 2. Various communicationflows 308 may be coordinated between the vehicle, autonomous vehicle orsemi-autonomous vehicle 1, vehicle, autonomous vehicle orsemi-autonomous vehicle 2, and vehicle, autonomous vehicle orsemi-autonomous vehicle 3 so as to enable group advertising to allvehicles within a geofenced area.

Referring now to FIG. 5, FIG. 5 depicts a larger vehicle, autonomousvehicle or semi-autonomous vehicle with one or more digital displaysaffixed to the side of the vehicle, autonomous vehicle orsemi-autonomous vehicle 502. These ads may be targeted to various othervehicles on a one to one vehicle, autonomous vehicle or semi-autonomousvehicle ad to vehicle, autonomous vehicle or semi-autonomous vehiclerecipient basis or based on a profile of the location or a profile ofthe cars or local advertisers 506. Advertisers may use ad networks, adexchanges, or other platforms to purchase viewing impressions forpassengers of vehicles. The display 502 of the truck 500 may be adigital, LED, LCD, OLED, or other display type. Advertisers may beenabled to bid on advertising space based on the vehicles of proximatevehicles 506. The interaction and reporting of how an advertisement isdisplayed from a first vehicle, autonomous vehicle or semi-autonomousvehicle to a second vehicle, autonomous vehicle or semi-autonomousvehicle enables targeted advertising on the roadways and furtherreal-time reporting.

Referring now to FIG. 6, FIG. 6 depicts various interactions with asmart window. The smart window may be affixed onto a traditionalvehicle, autonomous vehicle or semi-autonomous vehicle car window or maybe affixed to a car's window via adhesives or magnets. Content may bedisplayed on the window in a certain region 602. As an example, a ridein a taxi on a busy street with construction may be replaced with animmersive video of driving through a forest. The smart window may holdin memory various scenes and content to enable immersive drivingexperiences.

The smart window 600 may be touch enabled to allow finger presses orgestures to be used to access and control a plurality of menus. Thesmart window itself may have an operating system, CPU, processor,memory, and wireless transmit and receive components. Many of theseelectronics may be integrated as a system on a chip. Gestures can belearned or programmed to the smart window. For example, a swipe left onthe smart window 600 may advance the screen to the next ad unit, offer,video, music item, or content piece. A circle may indicate a distresssignal and cause other nearby vehicles or local authorities to bealtered. The smart window may be IP accessible and network connected.The smart window may also accept voice commands. The smart window may beenabled with a plurality of sensors including a proximity sensor, lightsensor, camera 610, among others. The proximity sensor may be used towake up the smart window display if a head is turned in the direction ofthe smart window. A plurality of cameras may be affixed to or integratedinto the smart window to allow for image acquisition outside thevehicle, autonomous vehicle or semi-autonomous vehicle or inside thevehicle, autonomous vehicle or semi-autonomous vehicle. The base of thesmart window 612 may be used to house a plurality of the electronics.Speakers may further be encased in the base 612 of the smart window. Aheadphone jack may also be enabled.

Referring now to FIG. 7, FIG. 7 depicts a plurality of smart windows inan industrial as used in instances such as a bus, autonomous car, train,or plane. Various transportation objects may allow for seats 708 to beswiveled or positioned facing outward toward the window instead offacing towards the front direction of the vehicle, autonomous vehicle orsemi-autonomous vehicle. In these instances users may be able to view afirst smart window 700 and its display area 702. Another user may beable to view a second smart window 704 and its display area 706. Thecontent in these instances may be different or centrally controlled. Asan example, a passenger drone may be configured to display land basedimages so as to give the appearance that flying in the air is reallytravelling along a road on the ground. Lighting may also be controlledby the smart window or in unison with an internet of things connectedlighting system to provide for a full immersive experience. The seatsthemselves 708 may be used to provide 4D motion such as a rumble orvibration to allow cinematic theater like experiences.

Referring now to FIG. 8, FIG. 8 depicts a smart window affixed to awindow of a vehicle, autonomous vehicle or semi-autonomous vehicle. Adisplay 802 may be OLED, LCD, LED, or another format. An OLED displaymay be expensive but more applicable for certain vehicles due to itsextremely thin profile. Various magnets may be used 804 or adhesives toaffix the smart window to the window of the car. A hardwire 806 mayconnect the display to an electronics base.

Referring now to FIG. 8, FIG. 8 depicts a smart window affixed to thewindow of a vehicle, autonomous vehicle or semi-autonomous vehicle. Avehicle, autonomous vehicle or semi-autonomous vehicle may be enabledwith one or more smart windows. The smart windows may be enabled with amedia capability to display pictures and video. Audio may be integratedinto a panel below the smart window or within the housing of the smartwindow. In yet another embodiment, the smart window may be touch enabledor voice responsive. The smart window may include electronics such as aCPU, GPU, memory, wireless connectivity unit, and further electronics.These electronics may be located with the door of a vehicle, autonomousvehicle or semi-autonomous vehicle or another part of the vehicle,autonomous vehicle or semi-autonomous vehicle or as a base 808.

Referring now to FIG. 9, FIG. 9 depicts various components of a displayand a touch screen interface for use in the smart window. Various touchscreen approach may be used 900 including electrical capacitance driven,electrical resistance driven, projected capacitance, or other sorts. Thedisplays may be enabled with an active matrix backplane and backlight.Certain display types will not need this. The display may have variouslayers 902 and cathode and anode to allow for the movement of organicmolecules. The layers 904 may be doubled up in certain cases. The smartglass housing may itself be plastic, glass or another material. Ananalog to digital converter may be used. The smart window may be touchenabled or non-touch enabled. In touch enabled scenario, a touch screencontroller or haptic controller may be integrated into the components. Afiller may be used in the screen, various filters, and conductors. Thesmart window may be connected to glass or the car glass window itselfvia adhesive, magnets, electric fields, magnetic fields. Various typesof displays maybe used including Organic Light Emitting Diode (OLED) andthose that are flexible in nature. OLED displays may for example behighly think in structure and separate the display from the electronicsneeded to power the display by either wired or wireless means. That isthe processing may be split from the display by a greater distance so asto enable a thin form factor. Various wired connections such as HDMI,USB-c, ethernet, VGA, or other cords may be used to connect the displayto the electronics.

Referring now to FIG. 10, FIG. 10 depicts various networking andcommunication between the smart windows, mobile devices, car centralwireless communication, and the in-car dashboard. The smart window 1000may be enabled to connect to a central vehicle, autonomous vehicle orsemi-autonomous vehicle wireless unit 1002 via Bluetooth, Zigbee, Wi-Fi,or other wireless protocol. The central wireless unit may serve as agateway, router, switch, and coordinate communication between all thedevices within the vehicle, autonomous vehicle or semi-autonomousvehicle and those outside on the Internet or other network. Theplurality of mobile devices may connect to each other or the vehicle,autonomous vehicle or semi-autonomous vehicle central unit via a meshnetwork, Wi-Fi Direct, or other protocol. These devices may further pooltheir network connectivity and bandwidth. The car dashboard 1006 may beused to control content on the smart window 1000. A mobile device 1004may also be used to control the content. The smart window itself 1000may have menus to control content.

Referring now to FIG. 11, FIG. 11 depicts various advertisingmonetization systems which may be integrated at the server or smartwindow level or a combination of both. These systems can enable buyersto purchase display time, ad units, or engagements for various vehicles.Various personalized and customized ad units 1102 may be served by an adexchange 1100 or ad network. The system may enable a cost per action orimpression 1104. In various instances, a user account with demographic,personality, and driving behaviors may be created 1106. The user accountand profile may grow and evolve over time 1106. The advertising systemsmay authenticate to one or more ride sharing and monetization platforms1108. The ad networks or exchanges 1100 may enable reporting back to thebrands and advertisers and also to the drivers 1110.

The broadcast of content from one smart window of a first vehicle,autonomous vehicle or semi-autonomous vehicle may also be sent to themobile devices or vice versa. It could also be sent from the vehicle,autonomous vehicle or semi-autonomous vehicle to another vehicle,autonomous vehicle or semi-autonomous vehicle. The brand units may bematched 1114 based on a cost per impression or cost per engagement basedon user profile information 1106. A marketplace may enable bid and askprices to be placed on vehicles 1116. A monetization server may collectpayments from the advertiser and send payments to the user's account ora ridesharing account. As an example a ride sharing program may allow apassenger to enable ads on the window of the car during their trip todefray the cost of the trip. The payments in this instance may then becredited against any cost to the driver of the vehicle, autonomousvehicle or semi-autonomous vehicle 1118. The state management of thewindows 1120 may be governed by a local hierarchy, by an application ona mobile device, or by a configuration software program in a processingand electronics system of the vehicle, autonomous vehicle orsemi-autonomous vehicle and accessible via the dashboard. In variousinstances, the software may be implemented in a form of instructionsaccessible in a computer readable medium and stored in the memory of alocal or network device. It is further an aspect of the system to enableadvertisements to be cached and stored locally or on the network toallow for transition advertisements.

In particular a real time advertising exchange may be enabled to capturea predicted customer based on the trajectory of their path.Additionally, vendors such as restaurants may place bids based on a timeof the day. Certain vehicles, autonomous vehicles or semi-autonomousvehicles may be associated with more often consumption at a particulartype of restaurant or fast food chain. Various remnant or a mix ofengagement ads and impression ads may be enabled 1122.

Referring now to FIG. 12, FIG. 12 depicts various components of an adsystem in communication with other devices including local and global adnetworks, media servers, and streaming services. Further, the device maybe enabled with various image processors to allow for object impressionsincluding people and passengers to be identified and advertised against.Cameras on the smart window or in the car may identify objects andtargets for advertisements.

A software subsystem may control the hardware of the smart windowdisplay to turn on or off the display based the presence of anadvertisement, roadway interaction or municipality regulation 1200. Thecontrol function may be processed by a local or network processor inconjunction with multiple wireless transmit and receive components. Thecontrol function may manage windows on/off and display settings. Thecontrol function may be influenced by location based services, RFID onfreeways, Radar towers, intelligent signs, and other physical hardwaresystems. The smart windows may be enabled to display media content 1202that is cached and stored in memory. The allocation of ads to variousmemory units may be based on a predicted transit route 1204. Thepredicted route may be based on an observed trajectory of the vehicle,autonomous vehicle or semi-autonomous vehicle on a roadway, a mapsserver, a navigation system, a image processor and image recognition ofthe vehicle, autonomous vehicle or semi-autonomous vehicle 1214, orother mechanism. The image processor system 1214 may be enabled on thesmart window itself, on the top of a vehicle, autonomous vehicle orsemi-autonomous vehicle, in a roadway sign or structure, or from aaerial drone. These image recognition systems are enabled to providereporting of vehicle, autonomous vehicle or semi-autonomous vehicletypes to ad servers and ad networks and to report on the types ofadvertisements that are indeed displayed. Certain ad units may beimmersive ad units 1212 if the vehicle, autonomous vehicle orsemi-autonomous vehicle is enabled with the capability. In thisvariation, a control message from a vehicle, autonomous vehicle orsemi-autonomous vehicle may enable a vehicle, autonomous vehicle orsemi-autonomous vehicle to display immersive ad units such that lightsmay be turned on or off or other visual cues may be enabled inconjunction with the video.

Various control mechanisms may be embedded in the smart window or in acentral vehicle, autonomous vehicle or semi-autonomous vehicleprocessing unit. That is a touch screen system in the central dashboardof a vehicle, autonomous vehicle or semi-autonomous vehicle may controlvarious functions of the smart windows or the smart windows themselves.The smart windows may receive streamed media 1202 via signals from thevehicles central wireless transmit and receive unit.

It is an aspect of the present disclosure to enable dynamic real-timepurchasing of advertisements or instead a specific time of advertisementpurchase. For example, an ad buy may purchase an entire geofenced area,a certain make and model of the vehicle, autonomous vehicle orsemi-autonomous vehicle, or a specific window.

In various embodiments, both hardware and software may be used toenabled the services as described herein. A smart window may include aprocessor, memory, wireless transmit and receive unit. In certainvariations, these components may be one system on a chip. The car itselfmay be in communication with the smart window or mobile devices. That isa first processor may exist in the smart window and a second processormay be in the car. A first wireless signal may be transmitted andreceived from the smart window to the car processor.

In some variations, a profile configuration tool may be used toestablish a user's profile and vehicle, autonomous vehicle orsemi-autonomous vehicle profile. This in onboarding process may allow avehicle, autonomous vehicle or semi-autonomous vehicle to setup amonetization account to receive payments and revenue from the ad paymentsystem. Additionally, the monetization system may enable a user to payfor a subscription video and media service for their car and smartwindows.

The use of the word vehicle, autonomous vehicle, or semi-autonomousvehicle is not intended to be limiting. The vehicle may be human driven.The vehicle may be fully autonomous. The vehicle may be semi-autonomous.Various combinations of these may also exist for each vehicle. Or thevehicle may just include one of the settings.

In other instances, the vehicle may have various levels of autonomy suchas levels 1 to 5 ranging from some systems being automated, to multiplesystems being automated, to self driving of certain aspects such asautomatic breaking, to fully autonomous without a user being involved inthe specific aspects of the driving.

The vehicle is not limited to surface level vehicles. Vehicle isintended to cover other mobility focused devices such a flying car withas a vertical take-off and landing (VTOL) device, flying taxi service,or a hybrid of a plane and a car.

In various instances, windows is used however the disclosure is alsoapplicable to the windshield or sunroof or moonroof or side mirrors orrear-view mirrors.

Touch Screen and Display Interaction

The material used for a touch screen display on the window and a displaysystem is not intended to be limiting in this disclosure. In onenon-limiting example, an OLED screen may be used. In a differentexample, a multi-layer film may be used. In these varied instances, theopacity and translucency of the films may vary.

In various instances, an exchange or application store may be providedby a third party, the vehicle manufacturer, or mobile device service topurchase content to place on the screens of the vehicles.

In various examples, the vehicles may include electric vehicles, plug-inhybrid cars, connected cars, ride sharing service cars, leased cars fromdealers, joint-ownership cars, pay-by-the mile ride sharing vehiclesamong others.

In one instance a server or a plurality of servers may be provided thatstore content environments for the vehicles. These content environmentsmay be available for purchase through an application store or contentstore. The environments may also be sponsored by an ad network,advertisers, brand, restaurants, and other third parties.

In addition, a digital rights management (DRM) system may be enabledwith a cloud based server or content store to allow users of the car topurchase immersive movies for the panorama rooftop. These content filesmay be sent from a remote server to a local server on a mobile devicewithin the vehicle or within an exchange is enabled for immersivecinematic experiences.

In one or more instances one or more cameras within the vehicle isenabled to capture users gestures and interaction. In these instances,the gestures within the vehicle by a user may be enabled to change theinside displays of the car. As an example, a user who makes a swipingmotion may be detected by an image recognition program running withinthe vehicle executed by a local in vehicle processor or a processorcoupled to the smart window.

Fully and Semi Autonomous Vehicle Screen Changes

In some examples, the vehicle when only in a fully autonomous mode isenabled to change the inside display screens including the windshield toinclude content such that the roadway is not visible and instead thecontent alone is visible. At least one processor on board the vehicle isenabled to detect when the vehicle is in autonomous mode. In thesesituations, the vehicle is enabled to active fully immersive content onwindows or screens including the front windshield which would normallyblock the view of a driver, but given that the vehicle is self-driving,the blocked view would not impede the driving of the vehicle. In thesesituations immersive content may be enabled for both the front side ofthe windows and windshield.

Alternatively, in this autonomous mode, the car front screen, sidescreens, and rooftop or one or more of the afore mentioned orcombinations thereof may be turned completely opaque. In these instancesthe advertisements, video content, and other directions may be displayedfor one or more users inside the car.

In some examples, in autonomous mode, the vehicle may serve as a safetyand precaution through the use of its screens to project or displaycontent outside the vehicle. The vehicle may use screens on the car tolight up the outside of the car windows with various hues, tints, oralternating colors. As an example, in a dark night, the car may light upthe windows in the side mirrors, side mirrors, or windshield with abright transparent or translucent color or content, to provide morelight to the cameras, LiDAR and sensors to acquire content. In otherself-driving autonomous modes, the car may use a series of outsideindication messages in the event of a potential collision with a car,object, pedestrian, or other item. These messages may be coupled withpre-set audio commands.

These changes to the display may be responsive to indications fromsensors that a potential collision or negative impact may occur. In oneinstance a camera may detect an potential object that the autonomousvehicle may collide with. In addition to lighting the front display, theoutside or street facing side of the front display may give a messagesuch as “Run Right!” or “Run Left” to the individual. Alternatively, themere bright lights of the vehicle may alert the presence of the vehicleto a pedestrian or other car. The outer displays may therefore be usedas part of a collision avoidance system. The outer displays may also beconfigurable to be display pattern which includes flashing sequences.

The collision avoidance system of the present disclosure is furtherenabled to make the vehicle move into a “wake-up” mode in which thewindshield turns clear and a side windows or a combination of theseitems displays bright screens to wake up the users in the autonomousvehicle.

In various instances the smart window system disclosed herein may beenabled to connect to the vehicle On-Board Diagnostics (OBD) portincluding OBD I or OBD II or any variant to enable information to flowbetween the smart window and the vehicle.

In various instances an augmented reality system may be enabled suchthat a camera may obtain content outside the vehicle and correspondinglyalter the content and display it on the inside window.

The foregoing description of specific embodiments of the presentdisclosure have been presented for purposes of illustration anddescription. They are not intended to be exhaustive or to limit thedisclosure to the precise forms disclosed, and it should be understoodthat many modifications and variations are possible in light of theabove teaching. The embodiments were chosen and described in order tobest explain the principles of the present disclosure, and its practicalapplication, to thereby enable others skilled in the art to best utilizethe present disclosure and various embodiments, with variousmodifications, as are suited to the particular use contemplated. It isintended that the scope of the disclosure be defined by the Claimsappended hereto and their equivalents.

What is claimed is:
 1. A method to display content on a window of avehicle that is at least partially autonomous capable, said methodcomprising: providing a digital window affixed to the window of thevehicle such that the digital window covers at least part of the window;wherein the digital window is touch enabled to allow one or moregestures to control access to content displayed on the digital window;receiving by one or more processors a first content from a server;displaying the first content on a first digital screen of the digitalwindow such that the first content is viewable on the outside of thevehicle; wherein the first content comprises an advertisement; whereinthe advertisement is associated with a dynamic real-time purchase of theadvertisement based at least in part on a geofenced area associated withthe vehicle; determining, by the server, the advertisement based on aplanned route of the vehicle and one or more of a location of thevehicle, a location of the starting point, and a location of adestination point; obtaining, by the server, a payment from anadvertiser, wherein the payment is sent to an account, associated with aridesharing service, to provide one or more payments to a driver or anowner of the vehicle; providing a second digital screen of the digitalwindow that covers at least part of the window facing the inside of thevehicle; wherein the second digital screen is on the reverse side of thefirst digital screen and the vehicle having an autonomous mode;capturing, by one or more cameras, a live video feed outside of thevehicle; and displaying the live video feed on the second digital screenof the digital window to provide a view of the outside of the vehiclefrom inside the vehicle.
 2. The method of claim 1, wherein the vehiclefurther comprises one or more sensors, a system including LightDetection and Ranging (LIDAR), a central processing unit (CPU) agraphics processing unit (GPU), a wireless transmit and receive unit,and a touch screen controller.
 3. The method of claim 2, wherein thefirst digital screen is enabled to display the first contentsimultaneously to the second digital screen displaying the live videofeed.
 4. The method of claim 3, wherein the advertisement is based atleast in part on one or more acquired images pertaining to objectsoutside the vehicle as obtained by the one or more cameras of thevehicle.
 5. The method of claim 2, wherein the second digital screenside of the digital window is activated only upon the vehicle being inthe autonomous mode.
 6. The method of claim 5, wherein the advertisementis further personalized based on a profile of a user in a ride sharingplatform associated with a trip.
 7. The method of claim 6, wherein theuser is allowed to enable advertisements to defray part of a cost of thetrip.
 8. A system to display content on a window of a vehicle, saidsystem comprising: a digital window affixed to the window of the vehiclesuch that the digital window covers at least part of the window; whereinthe digital window is touch enabled to allow one or more gestures tocontrol access to content displayed on the digital window; one or moreprocessors configured to receive a first content from a server; whereinthe one or more processors are configured to display the first contenton a first digital screen of the digital window such that the firstcontent is viewable on the outside of the vehicle; wherein the firstcontent comprises an advertisement; wherein the advertisement isassociated with a dynamic real-time purchase of the advertisement basedat least in part on a geofenced area associated with the vehicle;wherein the server determines the advertisement based on a planned routeof the vehicle and one or more of a location of the vehicle, a locationof the starting point, and a location of a destination point; wherein apayment is obtained, by the server; from an advertiser, wherein thepayment is sent to an account, associated with a ridesharing service, toprovide one or more payments to a driver or an owner of the vehicle; asecond digital screen of the digital window that covers at least part ofthe window facing the inside of the vehicle; wherein the second digitalscreen is on the reverse side of the first digital screen and vehiclehaving an autonomous mode; one or more cameras configured to capture alive video feed outside of the vehicle; and wherein the live video feedis enabled for display on the second digital screen of the digitalwindow to provide a view of the outside of the vehicle from inside thevehicle.
 9. The system of claim 8, wherein the vehicle is an autonomousvehicle; wherein the autonomous vehicle further comprises one or moresensors, a system including Light Detection and Ranging (LIDAR), acentral processing unit (CPU) a graphics processing unit (GPU), awireless transmit and receive unit, and a touch screen controller. 10.The system of claim 9, wherein the first digital screen is enabled todisplay the first content simultaneously to the second digital screendisplaying the live video feed.
 11. The system of claim 10, wherein theadvertisement is based at least in part on one or more acquired imagespertaining to objects outside the vehicle as obtained by the one or morecameras of the vehicle.
 12. The system of claim 9, wherein the seconddigital screen side of the digital window is activated only upon thevehicle being in the autonomous mode.
 13. The system of claim 12,wherein the advertisement is further personalized based on a profile ofa user in the ride sharing service associated with a trip.
 14. Thesystem of claim 13, wherein the user is allowed to enable advertisementsto defray part of a cost of the trip.
 15. The system of claim 8, whereinthe advertisement is targeted based at least in part on one or moreobjects that are identified from one or more captured images by the oneor more cameras.
 16. The system of claim 8, wherein the content includesan advertisement from a vendor located in proximity to the vehicle asdetermined at least in part by GPS.
 17. The system of claim 8, whereinthe digital window comprises an OLED display, wherein the OLED displayis touch enabled and further includes a touch screen controller.
 18. Thesystem of claim 8, wherein the digital window is enabled toautomatically dim and adjust the brightness based at least in part on aproximity sensor located as part of the digital window.